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(57) Abstract: An imaging apparatus with an autofocus mechanism for obtaining focused images. The apparatus comprises: an 
objective lens, a focus controller (16, 20) for altering a distance between the objective lens and a sample, an object finder (16) for 
finding objects of interest within the sample, and a light intensity measurement unit (14) which measures light intensity levels of the 
the identified objects of interest. The focus control alters the sample-objective distance to maximize the light intensity levels being 
measured, to thereby anive at a focus position. Objects of interest may be identified by filtering out laige objects and optionally by 
masking out background regions. The apparatus is useful for tnicroscopy and for fluorescent imaging in which light levels are low 
and noise is high. yi / ^ 'H 
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Image Focusing in Fluorescent Imaging 



Field of the Invention 
The present invention relates to focusing for image capture and more 
particularly but not exclusively to fluorescent imaging and to image focusing in 
high resolution scanning systems. 

Background of the Invention 

In high resolution scanning systems, focusing is a major rate-limiting 
step in that it is not unusual to find systems which spend approximately half of 
the imagmg time on focusing. Thus, optimizing the focusing process is 
important for providing system throughput For fluorescent imaging in 
particular, the situation is more extreme, as will be e^^lained below. 

Conventional microscopy focus algorithms rely on the images 
themselves. A series of unages at different focal planes is examined and the 
image with the largest amount of detail, or the greatest amount of information, 
is selected as being correctly focused. However, current systems are unable to 
distinguish between genuine details and noise, and thus images with high signal 
to noise ratio (SNR) are required for effective focusing. 

Considering conventional focusing in greater detail, conventional 
focusing relies on the quality of the images. In order to perform the focus 
sequence, the system takes a series of images around an esthnated focus 
position. For each unage, the system records its position, and computes a focus 
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score which characterizes the sharpness of the respective unage. In a final step, 
the system computes a position for which the focus score is maximal, and the 
computed position is taken as the focus position. 

The sharpness function is one of many functions that evaluate the 

5 amount of fme detaU in an image. A good sharpness fimction is sensitive (a 
small change in the amount of detail produces a large change in the focus 
score), and well-behaved over a large range. That is to say, as the distance 
from Ihe focus position increases, the focus score decreases, even for large 
distances from the focus position. Considering by w^ of example the 

10 following sequence: 

1. take an unage, 

2. convolve the image with a fine detail filtor (e.g. 
Sobel filter), 

3. sum the absolute value of the intensity of pixels in 

13 the convolved image, and 

4. set the focus score (FS) to the above sum. 

The above sequence is repeated typically five to tai times for each one 
of five to ten different images and a focus position is computed, preferably by 
interpolation between the unages to find a maximal sum position. 
20 The main drawback to the above-described sequence, and a drawback 

which applies to a complete family of functions, is tiiat they are sensitive to 
noise. Thus, unless image quality is good, the largest contribution for the focus 
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score comes from the noise, and both the requirements for sensitivily and for a 

large range are lost 

Fluorescent imaging is characterized as being a low light application, 
meaning that only low levels of Ught arq emitted from the sample. In addition, 

5 high resolution is needed in order to distinguish details of the sample. Thus a 
fluorescent imaging system is required to provide large magnification of the 
sample, to have a high capacity for collecting light and requires relatively long 
e)q>osure times in ord« to obtain a reasonable image. In order to provide the 
high magnification necessary, high m^fication objective lenses are used, 

10 typically of x40 and above. In order to achieve the high resolution and to 
collect as much light as possible, objective lenses with high numerical 
apertures (NA), typically 0.75 and above, are generally used. Typical exposure 
times of the order of a second and above are needed in order to obtain high 
quality, low noise images. 

15 It will be appreciated that a high NA causes a low deptii of field. Thus 

even slight deviations in tfie distance between the objective and the sample can 
lead to severe misfocusing of the image. Conventional focusing of the kind 
described above typically requires five-ten images. The requirement of low 
noise images means that the exposure time used for focus need to be similar to 

20 that used for tiie actual imaging. In the case of fluorescent imaging, a focusing 
time of around five-ten seconds is therefore implied. Thus in fluorescent 
imaging the system spends the vast majority of its time focusing, and Ae 
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focusing problem is an obstacle to providing a high throughput fluorescent 
imaging system. 



Summaiy of the Invention 
5 The embodiments described herein overcome the difficulties explained 

above by removing the dependence on image details such as differential 
information and high frequency details, in the process of focusing. Instead, it 
uses the image energy, that is to say integral information and low frequency 
details for finding the focal position. The ©mbodiments are flius able to be used 
10 on relatively noisy images, which can be focused rapidly. The system is 
particularly useful for providmg fast throughput for large quantities of data. 

According to a first aspect of the present mvention there is an miagmg 
apparatus for taking images of samples, the apparatus comprising: 
an objective lens, 

15 a focus controller for altering a distance between the objective lens and 

the sample, 

an object finder for finding objects of interest within the sample, and 
a light intensity measurement unit, associated with the focus controller, 

arranged to measure light intensity levels, gathered through the objective lens, 
20 of the objects of interest, tiie apparatus being operable to alter tiie distance to 

maximize tiie light intensity levels, thereby to find a focus position. 

Preferably, the focus controller is controllable to stepwise alter the focus 

tiirough a series of distances to allow the light intensity measurement unit to 
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measure the light intensity at each of the focus distances, therefrom to select 
one of the focus distances giving maximum intensity as the focus position. 

The apparatus may be comprised within a camera, meaning that it is 
configured to work with the camera objective to provide autofocus for the 
5 camera. 

Typically, the sample used is a fluorescent sample, suice images of 
fluorescent samples are typically high noise and hard to focus using 
conventional methods. 

Preferably, the object finder comprises a small object filter for filtering 
10 to include only small objects of the sample. 

Preferably, the object finder comprises a bright object filter for filtering 
out objects fluorescing above a predetermined fluorescing threshold. 

Preferably, the object finder comprises a backgroimd filter for filtering 
out a background color. 
15 Preferably, the object finder comprises a background filter for filtering 

out a background color. 

The apparatus may fiirther comprise a filter for filtering out objects 
fluorescing above a predetermined fluorescing threshold. 

Preferably, the small object filter is operable to filter out regions not 
20 being objects occupying less space than substantially 500 pixels of an image. 

Preferably, the light intensity measurement unit is opemble to compute 
an average intensity over an image taken of the sample using at least a first of 
the focusing distances. 



5 



wo 03/014795 PCT/IL02/00643 

Preferably, the light intensity measurement unit is further operable to 
compute a standard deviation of flie intensity over the image. 

The apparatus may further comprise a thresholder associated with the 
light intensity measuremmt unit for using the average intensity and the 
5 standard deviation to compute an image threshold for thresholding pixels of the 
image. 

Preferably, the threshold is the average intensity plus a predetermined 
image constant times the standard deviation. 

Preferably, the thresholder is operable to compute a focusing threshold 
10 in addition to the image threshold. 

Preferably, the focusing threshold is the average intensity plus a 
predetermined focusing constant times the standard deviation. 

Preferably, the small object filter is operable to filter for the small 
objects by forming a mask by setting to zero any pixel that is outside of an 
1 5 object being smaller flian a predetermined blob size. 

The apparatus may fiuther comprise a thresholder, operable to threshold 
an image using a brightness threshold. 

Preferably, the thresholder is operable to threshold for brightness 
separately for color bands of the unage. 
10 Preferably, the thresholder is operable to threshold for brightness 

separately for color bands of the image such as to filter out a color associated 
with an image background, thCTcby to provide a background filter. 
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The apparatus may further comprise combination logic for ANDing the 
thresholded imiage with the mask. 

The apparatus may further comprise combination logic for ANDing the 
thresholded image with the mask, thereby to form an image comprising 
S delineated objects of interest. 

The apparatus may further comprise a noise remover operable to set to 
zero each pixel of the image lacking at least one non-zero pixel as a neighbor. 

Preferably, the noise remover comprises a rank filter. 

The apparatus may further comprise a focus scorer for computing a 
10 focus score to an image, the focus scorer comprising a simmiator for summing 
over substantially each pixel in the image the difference, raised to the power of 
a predetermined constant, between the pixel intensity level and the average 
intensity level for the image. 

The apparatus may further comprise the predetermined constant is a 
1 5 positive number. 

Preferably, the predetermined constant is substantially 2. 

The apparatus may further comprise a comparator associated with the 
focus scorer, for detennining which of the images gives a maximum score, 
thereby to select an optical focus position. 
20 The apparatus may further comprise an exposure timer having a 

predetermmed e)qx)sure time for producing focusing images and a 
predetermined exposure time for producing viewing images and the 
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predetermined e?q)os\ire time for producing focusing images may typically be 
shorter than the predetermined exposure time for producing viewing images. 

Preferably, a ratio between the exposure times is substantially between a 
third and a fortieth. 

In a particularly preferred embodiment, the ratio between the exposure 
times is substantially between a tenth and a fifth. 

Preferably, a ratio between the exposure times is calculable by taking 
substantially the square root of a ratio between a typical image SNR and an 
empirically determined SNR for a given focused image. 

Preferably, the exposure timer is set to mcrease the predetermined 
e?q)0sure time for producing focusing images in the event of a determination of 
a focusing failure, 

The apparatus may further comprise a comparator for determining a 
diySTerence between focus scores of successive images, the apparatus being 
operable to reduce expostue time when the difference is above a predetermined 
level. 

The apparatus may further comprise a focus score adjuster operable to 
adjust respective focus scores of focusing images to compensate for the 
reductions in the exposure time. 

The apparatus may further comprise pixel binning functionality to 
increase a signal to noise ratio of the images. 
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The apparatus may further comprise a light intensity detector connected 
to a servo-unit for altering the distance, the servo-unit being controllable to 
alter the distance to maximize light intensity as detected by the detector. 

The apparatus may further comprise a large object detector for inhibiting 
5 action of the servo-unit when the presence of a large object is detected. 

The apparatus may further comprise a low magnification pre-scanner for 
determining whether large objects are present m the sample, and inhibiting the 
operation of the server unit in the presence of the large objects. 

Preferably, the light intensity detection unit comprises a multi-pixel 

10 array. 

Accordmg to a second aspect of the present mvention there is provided a 
method of inmge focusing comprising: 
illimiinating a sample, 

collecting light fix)m the sample via an objective lens, therefirom to form 
IS an image, 

identifying objects of interest within the image, and 

focusmg the sample by altering a distance between the objective lens 

and the sample to maximize light intensity gathered firom the identified objects 

of interest 

20 Preferably, the step of identifying objects of interest comprises filtering 

for small objects in the hnage. 

According to a third aspect of the present invention there is provided a 
method of producing a focused image comprising : 
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taking a series of images, 

over the series filtering for small objects, 

over the series thresholding the images against a threshold brightness 

level, 

S summing intensities of each filtered and thresholded image to form a 

focusing score for each image, and 

selecting a focusing distance substantially corresponding to that of an 
image having a maximum focusing score. 

According to a fourth aspect of the present invention there is provided 
10 an autofocus device for use in imaging, the device comprising: 

an objective lens bemg controUably focusable on the sample by altering 
a distance between the lens and the sample, 

an object identifier for identifying regions of interest within an 
unfocused image of the sample, and 
15 a light mtensity measurement unit arranged to measure light intensity 

levels of the objects of interest gathered by the objective lens, and wherem the 
autofocus device is operable to alter the distance to maximize the measured 
light intensity levels. 

Preferably, the altering of the distance comprises altering the distance 
20 stepwise to measure the light intensity at each of the steps and to select a one of 
the steps giving maximum intensity as a focus distance. 

Preferably, the object identifier comprises a small object filter for 
filtering for small objects of the sample. 

10 
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Preferably, the small object filter comprises a blob analyzer having a 
predetermined blob size, for recognizing objects that do not exceed the 
predetennined blob size. 

Preferably, the predetermined blob size is substantially 500 pixels. 

Preferably, the light intensity measurement unit is operable to compute 
an average intensity over an image taken of the sample using at least a first of 
the focus steps. 

Preferably, the light intensity measurement unit is further operable to 
compute a standard deviation of the intensity over the image. 

The autofocus device may further comprise a thresholder, associated 
with the light intensity measurement unit, for using the average intensity and 
the standard deviation to compute an image intensity threshold for thresholding 
pixels of the image. 

Preferably, the image intensity threshold is the average intensity plus a 
predetennined image constant times the standard deviation. 

Preferably, the thresholder is operable to compute a focusing threshold 
in addition to the image threshold. 

Preferably, the focusing threshold is the average mtensity plus a 
predetermined focusing constant times the standard deviation. 

Preferably, the small object filter is operable to form a mask firom an 
image taken at a predetermined focus position by setting to zero any pixel not 
being part of an object that is smaller than a predetennined large object 
threshold. 
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The autofocus device may fiirther comprise combination logic for 
ANDing the thresholded image with this mask, thereby to form an image 
delineating the objects of interest. 

The autofocus device may further comprise a noise remover operable to 
5 set to zero each pixel of the image lacking at least one non-zero pixel as a 
neighbor. 

Preferably, the noise remover comprises a rank filter. 

The autofocus device may further comprise a focus scorer for computing 
a focus score to an image, the focus scorer comprising a simimator for 
10 summing over substantially each pixel in the image the difference, raised to the 
power of a predetemuned constant, between the pixel intensity level and the 
average intensity level for the image. 

The autofocus device may further comprise the predetermined constant 
is a positive number. 
15 Preferably, the predetermined constant is substantially 2. 

The autofocus device may further comprise a comparator, associated 
with the focus scorer, for determining which of the images gives a maximum 
score, thereby to alter the distance to a distance corresponding to the position to 
focus the sample. 

20 The autofocus device may further comprise an exposure timer having a 

predetermined exposure time for producing focusing images and a 
predetermined exposure time for producing viewing images. The 
predetermined exposure time for producing focusing images is preferably 
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arranged to be shorter than the predetermined exposure time for producing 
viewing images. 

Preferably, a ratio between the e5q>osure tunes is substantially between a 
fifth and a fortietfi. 

5 In a particularly preferred embodiment, the ratio between the e^qposure 

times is substantially between a tenth and a twentieth. 

Preferably, the ratio between the «posure times is obtainable by taking 

the square root of a ratio between a typical image SNR and an empirically 

determined SNR for a given focused image, 
10 Preferably, the exposure timer is set to increase the predetenmmed 

exposure time for producing focusing images in the event of a determination of 

a focusing failure. 

The autofocus device may further comprise a comparator for 
determining a difference between focus scores of successive images, the 
15 apparatus being operable to reduce exposure time when the difference is above 
a predetermined level. 

The autofocus device may further comprise a focus score adjuster 
operable to adjust respective focus scores of focusing images to compensate for 
the reductions m the e?q)osure time. 
20 Hie autofocus device may further comprise pixel biiming functionality 

to increase a signal to noise ratio of the unages. 

The autofocus device may further comprise a low magnification pre- 
scanner for determining whether large objects are present in a sample to be 
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imaged, and inhibiting the operation of the server unit in the presence of the 
large objects. 

Preferably, the light intensity detection unit comprises a multi-pixel 

array. 

5 According to a fifth aspect of the present invention there is provided an 

autofocus device for a fluorescence imagmg microscope, the device comprising 
an image filter for filtering an image to delmeate objects of interest and a light 
intensity measurement unit dissociated with a focusing mechanism for focusing 
by altering a focus distance to maximize measured light intensity of the filtered 

10 image. 

The device may cany out the focusing using image data gathering at a 
lower data level than a data level needed for imaging. 

Brief Description of the Drawings 
15 For a better understandmg of the invention, and to show how the same 

may be earned into effect, reference will now be made, purely by way of 
example, to the accompanying drawings, in which: 

Fig. 1 is a generalized diagram showing a fluorescent imaging apparatus 
for taking images of fluorescing samples, 
20 Fig. 2 is a simplified flow chart showing a method of focusing using a 

preferred embodiment of the present invention. 
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Fig. 3 is a simplified flow chart showing a preferred method for 
dynamically selecting an exposure time in accordance with a preferred 
embodunent of the present invention, 

Fig. 4 is a focusing curve achieved using a prior art system, 

Fig. S is a focusing curve obtained using a system according to a 
preferred embodiment of the present invention, and 

Fig. 6 is an image obtained during the focusing process according to an 
embodiment of the present invention, multiplied ten times for viewing. 

Description of the Preferred Embodiments 
Reference is now made to Fig. 1, which is a generalized diagram 
showing fluorescent imaging apparatus for taking images of fluorescing 
samples. An apparatus 10 comprises a fluorescent microscope 12, connected to 
a camera 14 and to a motorized focus mechanism 20, all of which are 
connected to a computer 16. The computer is preferably connected to receiye 
data from and to control both the camera and the motorized focus 20. The 
microscope 12 preferably comprises an illumination source 18 for illuminating 
a fluorescent sample. Emitted, reflected and fluorescent light is received back 
at the microscope 12. 

As is common in microscopy, tiie illumination source 18 is preferably 
situated behind the objective lens of microscope 12, so as to illuminate the 
sample via the objective lens. Such a form of illumination has two effects, 
firstly that it concentrates illumination in the focal plane and secondly that it 
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reduces noise in the image since the microscope picks up only emitted light and 
not transmitted light. 

Preferably, the apparatus is provided with a light intensity measurement 
unit 20 arranged to measure light intensity levels of the sample as gathered by 
5 the objective lens. Preferably the light intensity is measured on a per pixel 
basis. 

Preferably, the light intensity measurement unit is associated with 
control of the distance between the objective lens and the sample. Generally 
the sample, or more precisely the sample mounting stage is moved, in order to 

10 cany out focusing. In principle it is also possible to move the objective lens, 
but such is not usually done. The distance is controlled in response to lig^t 
intensity measurements, preferably using motorized focus mechanism 20. As 
mentioned above, the use of the objective lens as a route for the illumination 
light ensures that the image is most highly illuminated when it is In the focal 

IS plane. Thus, measured light intensity reaches a maximum when the sample is 
in the focal plane of the objective lens. Hence it is possible to control changes 
of the focus distance to maximize the intensity signal, thereby focusing on the 
sample. 

The above principle works as long as the sample is not large relative to 
20 the field of view. If the sample is large than it has the effect of integrating the 
light signal to give an overall light intensity which is high even when the 
sample is not focused. Methods for removing large objects from consideration 
will be discussed below. 
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la one preferred embodiment of the present invention a focusing 
procedure is carried out in which the camera is set to a &st e^osuie rate and 
then a series of images are taken. Light intensity is measured at each image to 
deteraiine an image which has a maxhnum light intensity. The motorized focus 
5 is moved to a position corresponding to the image having the maximum light 
intensity and the microscope is now focused. 

Referring now to Fig. 2, the focusing procedure of the above 
embodunent is discussed in more detail as follows: 

First of all the camera is set to its focus parameters, namely to a setting 
10 of fast exposure and high gain, and a set of images is taken at different focusing 
positions. 

A first image is then set as (II). 

The following procedure is then carried out with the furst image to 
obtain threshold levels and a mask to remove large objects and keep only small 
15 objects. 

The average mtensity lav and standard deviation, a; are computed for 
the first image. 

The image is tfaresholded using the image threshold Th= Iav+k*a, where 
k is a constant. Atypical value fork would be 3. 
20 Removal of large objects J&om the image is carried out using a process 

known as blob analysis. 

In blob analysis, blobs, that is relatively uniform areas that are smaller 
than a given size, are identified. Typically, the size is measured in terms of 
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pixels of the image size, and a typical size, represented by a parameter A, may 
be 500 pixels. Thus, a mask is goierated of blobs smaller than A (A==500); a 
value of 1 is assigned to all pixels outside the blobs, and 0 to all pixels in the 
blob. The mask Aereby produced is referred to as image 12. 
5 12 is logically "anded" with II. The values of lav and of o are 

recalculated. 

A focus threshold is computed using Fth= Iav+c*<y, where c is a constant 
A typical value for c is 3.5. 

Then, for all unages including the first, the following procedure is 
10 carried out. 

The respective image (II) is thresholded using the focusing threshold 
F,h. That is to say 0 is assigned to all pixels below Fu,, and all other pixels are 
left unchanged. The new image is referred to hereinbelow as 13. 

A logical AND is then carried out of thresholded hnage 13 and mask 12. 
15 The skilled person will appreciate that the order of the thresholdmg and 
ANDing steps may be switched. The result is referred to herein as 14. 

14 is cleaned of random noise, preferably by requiring that each pixel in 
14 has at least one non-zero neighbor. Such cleanmg may be achieved by 
perfonnmg a rank filter on 14. The resulting unage is referred to herein as 15. 
20 The focus score, F may tfien be computed as 

F—^all image pixels (Ipixcl" ^av) * 

where Ipixei.is the gray level of the pixel in 15, and a is. a positive 
number, typically a=2. 

18 
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The actual focus position is then taken to be the position corresponding 
to the image having maximal focus score. 

Filtering for small objects using blob analysis leads to identification of 
two types of objects, cell objects and non-cell objects. It is possible to filter out 

5 the non-cell objects using the following procedure. Generally any given slide 
is likely to have a uniform background color, and it is possible, in a color 
image, to filter out the background color. In the Aresholding stage above, it is 
possible to carry out thresholding according to color bands and to filter out 
entirely the color corresponding to the background. Such a technique thus 

10 ensures that the final image comprises small objects that do not share the non- 
cell background color, that is to say it includes the objects likely to be of 
interest to the biologist 

For a monochrome image, the filtering out of the background is still 
possible but is more complex since it has to be based on recognizmg uniformity 

15 in gray level and texture. 

As maitioned above, the oqposure times during focusing may be 
considerably lower than the exposure times necessary for achieving a fiiU 
viewing image. The reduction is due to the procedure above mentioned. An 
e3q)05ure timer may use a predetermined reduced exposure time set at between 

20 a fortieth and a third, and preferably between a fifth and a tenth, of the regular 
exposure time. 

In a fijrther preferred embodiment of the present invention a fixed ratio 
between exposure times is dispensed with and instead, image statistics are used 

19 
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to set the exposure times. For example a useful ratio is obtained by taking a 
typical image SNR. An empirically determined SNR is defined for a focused 
image and the ratio between the two is calculated. The square root of the 
calculated ratio is then used as the ratio between the e3q}0sure times. 

5 In a further preferred embodiment, the exposure timer may be set such 

that, in the event of a failure to focus, the focusing e;q)Osure time is increased. 
Generally, a characteristic of fluorescent images is a clustCT of bright pbcels 
around the region of a positive signal* The above-described use of the rank 
filter accentuates the characteristic. An image not carrymg very much 

10 information is unlikely to have pixel clustering and thus the rank filter is liable 
to remove much of the light in the image, giving such an image a very low 
focusing score. Such a low score may be recognized as a failure to focus, 
encouraging an increase in focus time as described. 

On flic other hand, in the event of a surfeit of information, the opposite 

15 procedure may be followed. With reference now to Fig. 3, in a preferred 
embodiment a large difference between the scores of succeeding images in a 
series is recognized as a sign of having more flian sufficient information. Hius 
the apparatus may reduce exposure time. It is appreciated that in using results 
from images with different exposure times the scores are preferably weighted 

20 with a factor to render them comparable. Thus if one image has an exposure 
time of a tenth of a second and the following image is taken using an exposure 
time of a twentieth of a second, the score of the second image is calibrated so 
as to be comparable to that of the first image. 

20 
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Considering Fig. 3 in more detail, a first image is taken and a focus 
score is computed. Hie score is multiplied by a focus fector, currently 1. A 
second image is then taken and a score computed. Again the score is 
multiplied by the focus factor which is stilll. The second score is subtracted 

5 from the first score and the result is compared with a threshold gradient GRAD. 
If the threshold is exceeded, and the first focus score is larger than a predefined 
threshold score, a festw ejq)Osure time is set and die focus factor is updated to 
be the ratio between the old and the new ejqjosure times to the power a, 
whoein a is as defined hereinabove. 

10 Certdn cameras are provided with what is known as a pixel binning 

feature (sometimes called also meta-pixe! or super-pixel). The feature takes an 
internal group of pixels and treats this group as a single pixel. The effect of 
pixel binnmg is to decrease resolution and at the same time to increase SNR. 
Pixel binning can be helpful in the focusing procedure as outlined above since 

15 the resolution has no effect on die above-described focusing procedure, while 
increased SNR may ftirther shor^ die ejqposure times. Thus, as long as the 
pixel binning does not interfere with the identification of large objects tiien it 
may usefiilly be incorporated into die focusing procedure. 

A simplified embodiment of die present invention may use the detected 

20 light level to directiy operate the motorized focus 22 in the direction of 
increasing light level until a peak is determined. In tius case, any li^t meter 
can be used (e.g. a photodiode, avalanche photodiode or a photomultiplier). 
Such a simplified embodiment of the invention is sufficient as long as Uiere are 
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no large objects in the vicinity. Thus, in a preferred embodiment, a large object 
detector, for example the blob analyzer discussed above, may be used as a 
switch between such a simplified embodiment and an embodiment involving 
tibe masking etc procedure outlined above. Alternatively switching can be 
carried out using a low magnification pre-scanner. The low magnification pre- 
scanner preferably uses a low magnification small NA objective lens to 
produce a pre-scan image, which is then fed to the computer 16. The computer 
16 is able to determine whether large objects are present in the sample, and to 
select accordingly between the simplified and the more complex embodiments. 

In one preferred embodiment, the light intensity detection unit is made 
up of a multi-pixel detector array, for example a 4x4 array. Using such an 
array is the equivalent of using ultra-low resolution unaging. The array has the 
effect of discarding regions where large objects are present, and using 
information coming only fi:om relevant areas. Nevertheless, real-time focusing 
is still possible. 

A minimal system may be built fi:om a fluorescent imager that can 
change the distance between the objective and the sample in a controlled 
maimer. A prototype was built using a Zeiss Axioplan2 microscope, a Sony 
DXC9000 CCD camera, and a standard general-purpose computer. In order to 
test the prototype a biological sample was stained with a specific fluorescent 
DNA probe. 

The computer controls the camera and the distance between the sample 
and the objective, grabs images firom the camera and analyzes the results. A 
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typical focus sequence begins when the computer detennines the initial 
distance ZO between the objective and the sample. The computer sets the ZO 
•distance and grabs an image from the camera. The image is analyzed and a 
focus score FO for the current image is computed. The computer than sets 

5 another distance Zl, grabs an image and computes its score Fl. This sequence 
is repeated until it is possible to select a position Ffocus where a peak in the 
focus score is found, as described above. 

In a test example to compare the performance of the traditional and the 
new focus methods, images were taken at different positions, and a focus curve 

10 was computed using each method. The sample was a regular blood sample, 
stained for the sex chromosomes using probes produced by Vysis Ltd. The final 
images were taken with an exposure time of 2 seconds. Figures 5 and 6 show 
typical focus curves on an image. The focus images when focusing using an 
embodunent of the invention were taken with an exposure time of lOOmSec 

1 5 only, 20 tunes faster than for the conventional method. 

Reference is now made to Fig. 4, which is a gr^h showing a focus 
curve for the above example using a prior art focusing system. In the graph a 
focus score produced by the filter, in this case a Sobel sharpness filter, is traced 
against distance from optimd focus. It is noticeable that there is a noticeable 

20 peak in the region of - 1 .5 to 1 .5 microns from optimal focus, in which the focus 
score raises from around 900 to around 1000. Outside the above-mentioned 
region there is very little change in the score. Thus the score at 3 microns from 
optimal focus is practically the same as flie score at 2 microns. 
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Reference is now made to Fig. 5, which is a graph showing a focus 
curve as produced by embodiments of the present invention. In Fig. 5, again 
focus score is plotted against distance from optimal focus. This time the focus 
score in the same region, -1.5 to 1.5 microns, varies between 50 and 1000, 
5 which is to say that the discrimination of the system is considerably higher. 
Also, outside the region there are noticeable differences in scores. The score 
drops between 2 and 3 microns! 

Reference is now made to Fig. 6, which shows an image obtained during 
the focusing process using an embodiment of the present invration. The image 
10 that is shown and used is the clearest of the respective set of focusing images. 
To enable viewing, the gray levels of the original im^e have been multiplied 
by 10. It will be noticed that the image itself has a high level of noise, making 
standard focusing methods ineffective. 

There is thus provided, according to the above embodunents, a focusing 
15 unit for fluorescent microscopy, which is able to carry out automatic focusing 
on a high noise image of the kind typical of fluorescent imaging. 

It is appreciated that features described only in respect of one or some of 
the embodiments are applicable to other embodiments and that for reasons of 
space it is not possible to detail all possible combinations. Nevertheless, the 
20 scope of the above description extends to all reasonable combinations of the 
above-described features. 
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The present invention is not limited by the above-described 
embodiments, which are given by way of example only. Rather the invention 
is defined by the appended claims. 
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1. An imaging apparatus for taking images of samples, the 
apparatus comprising: 

an objective lens, ' 

a focus controller for altering a distance between said objective lens and 
said sample, 

an object finder for finding objects of interest within said sample, and 
a light intensity measurement unit, associated with said focus controller, 
arranged to measure light intensity levels, gathered through said objective lens, 
of said objects of interest, said apparatus being operable to alter said distance 
to maximize said light intensity levels, thereby to find a focus position. 

2. The imaging apparatus of claim 1, wherein said focus controller 
is controllable to stepwise alter said focus through a series of distances to allow 
said light intensity measurement unit to measiire said light intensity at each of 
said focus distances, therefrom to select one of said focus distances giving 
maximum intensity as said focus position. 

3. The imaging apparatus of claim 1, being comprised within a 
camera. 
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4. The imaging apparatus of claim 1, where said sample is a 



fluorescent sample. 

5. The imaging apparatus of claim 1, wherein said object finder 
comprises a small object filter for filtering to include only small objects of said 
sample. 

6. The imaging apparatus of claim 4, wherein said object finder 
comprises a bright object filter for filtering out objects fluorescing above a 
predetermined fluorescing threshold. 

7. The fluorescent unaging apparatus of claim 4, wherein said 
object finder comprises a background filter for filtering out a background color. 

8. The fluorescent imaging apparatus of claim 6, wherein said 
object finder comprises a background filter for filtering out a background color. 

9. The imaging ^paratus of claim 1, fiirther comprising a filter for 
filtering out objects fluorescing above a predetermined fluorescing threshold. 

10. The unaging apparatus of claim 5, wherem said small object filter 
is operable to filter out regions not being objects occupying less space than 
substantially 500 pixels of an image. 
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11. The imaging apparatus of claim 3, wherein said light intensity 
measurement unit is operable to compute an average intensity over an image 
taken of said sample using at least a first of said focusing distances. 

12. The imaging apparatus of claim 11, wherein said light intensity 
measurement unit is further operable to compute a standard deviation of said 
intensity over said image. 

13. The imaging apparatus of claim 12, further comprising a 
thresholder associated with said light intensity measurement miit for using said 
average intensity and said standard deviation to compute an image threshold for 
thresholding pixels of said image. 

14. The imaging apparatus of claim 13, wherein said threshold is the 
average intensity plus a predetermined image constant times the standard 
deviation. 

15. The imaging apparatus of claim 13, wherein said thresholder is 
operable to compute a focusing threshold in addition to said image threshold. 
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16. The imaging apparatxis of claim 15, wherein said focusing 
threshold is the average intensity plus a predeteimined focusmg constant times 
the standard deviation. 

17. The imaging apparatus of claim 5, whereui said small object jBlter 
is operable to filter for said small objects by forming a mask by setting to zero 
any pixel that is outside of an object being smaller than a predetermined blob 
size. 

18. The imaging apparatus of claim 17, further comprising a 
thresholder, operable to threshold an image using a brightness threshold. 

19. The imaging apparatus of claim 18, wherein said thresholder is 
operable to threshold for brightness separately for color bands of said image. 

20. The imaging apparatus of claim 19, wherein said thresholder is 
operable to thre^old for brightness separately for color bands of said image 
such as to filter out a color associated with an image background, thereby to 
provide a background filter. 

21. The unaging apparatus of claim 17, fiirther comprising 
combination logic for ANDing said thresholded image with said mask. 
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22. The imaging apparatus of claim 20, further comprising 
combination logic for ANDing said thresholded image with said mask, thereby 
to form an image comprising delineated objects of interest. 

23. The imaging apparatus of claim 21, further comprising a noise 
remover operable to set to zero each pixel of said image lacking at least one 
non-zero pixel as a neighbor. 

24. The imaging apparatus of claim 23, wherein said noise remover 
comprises a rank filter. 

25. The imaging apparatus of claim 24, further comprising a focus 
scorer for computing a focus score to an image, the focus scorer comprising a 
summator for summing over substantially each pbcel in die image the 
difference, raised to the power of a predetermined constant, between the pixel 
intensity level and the average intensity level for the image. 

26. The imag^ig apparatus of claim 2S, wherein said predetermined 
constant is a positive number. 

27. The imaging apparatus of claim 26, wherem said predetermined 
constant is substantially 2. 
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28. The imaging apparatus of claim 27, further comprising a 
comparator associated with said focus scorer, for determining which of said 
images gives a maximum score, thereby to select an optical focus position. 

29. The imaging apparatus of claim 1, comprising an exposure timer 
having a predetermined exposure time for producing focusing unages and a 
predetemuned exposure time for producing viewing images and wherein said 
predetermined exposure time for producing focusing images is shorter than said 
predetennined e^q^osure time for producing viewing images. 

30. The imaging apparatus of claim 29, wherein a ratio between said 
exposure times is substantially between a third and a fortieth. 

31. The imaging apparatus of claim 29, wherein a ratio between said 
exposure times is substantially between a tenth and a fifth. 

32. The imaging apparatus of claim 29, wherein a ratio between said 
exposure times is calculable by taking substantially the square root of a ratio 
between a typical image 3NR and an empuically determined SNR for a given 
focused image. 
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33. The imaging sppmitos of claim 29, said exposure timer being set 
to increase smd predetermined ejqiosure time for producing focusing images in 
the event of a determination of a focusing failure. 

34. The imaging apparatus of claun 25, comprising a comparator for 
deteraiimng a difference between focus scores of successive images, said 
q)paratus being operable to reduce exposure time when said difference is above 
a predetermined level. 

35. The imaging apparatus of claim 34, further comprising a focus 
score adjuster operable to adjust respective focus scores of focusing images to 
compensate for said reductions in said e?qposure time. 

36. The imaging apparatus of claim 1, further comprising pixel 
binning fimctionality to increase a signal to noise ratio of said images. 

37. The imaging apparatus of claim 1, comprismg a light intensity 
detector connected to a servo-unit for altering said distance, said servo-unit 
being controllable to alter said distance to maximize light intensity as detected 
by said detector. 
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38. The imaging apparatus of claim 37, further comprising a large 
object detector for inhibiting action of said servo-unit when the presence of a 
large object is detected. 

39. The imaging apparatus of claim 37, comprising a low 
magnification pre-scanner for determining whether large objects are present in 
the sample, and inhibiting the operation of said server unit in tfie presence of 
said large objects. 

40. The imaging apparatus of claim 1, said light intensity detection 
unit comprismg a multi-pixel array. 

41. A method of image focusing comprising: 
illuminating a sample, 

collecting light from said sample via an objective lens, therefrom to 
form an image, 

identifying objects of interest within said image, and 

focusing said sample by altering a distance between said objective lens 
and said sample to maximize light intensity gathered fix>m said identified 
objects of interest. 

42. A method according to claim 41 wherein said step of identifying 
objects of interest comprises filtering for small objects in said image. 
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43. A method of producing a focused image comprising : 
taking a series of images, 

over said series filtering for small objects, 

over said series thresholding said images against a threshold brightness 

level, 

summing intensities of each filtered and thresholded image to form a 
focusmg score for each image, and 

selecting a focusing distance substantially corresponding to that of an 
image having a maximimi focusing score. 

44. An autofocus device for use in imaging, the device comprising: 
an objective lens being controUably focusable on said sample by altering 

a distance between said lens and said sample, 

an object identifier for identifying regions of interest within an 
unfocused image of said sample, and 

a light intensity measurement unit arranged to measure light intensity 
levels of said objects of interest gathered by said objective lens, and wherem 
said autofocus device is operable to alter said distance to maximize said 
measured light intensity levels. 

45. The autofocus device of claim 44, wherein said altering of said 
distance comprises altering said distance stepwise to measure said light 
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intensity at each of said steps and to select a one of said steps giving maximum 



intensity as a focus distance. 

46. The autofocus device of claim 44, wherein said object identifier 
comprises a small object filter for filtering for small objects of said sample. 

47. The autofocus device of claim 46, wherein said small object filter 
comprises a blob aiudyzer having a predetermined blob size, for recognizing 
objects that do not exceed said predetermined blob size. 

48. The autofocus device of claim 47, wherein said predetermined 
blob size is substantially 500 pixels. 

49. The autofocus device of clahn 45, wherein said light intensity 
measurement unit is operable to compute an average intensity over an image 
taken of said sample using at least a first of said focus steps. 

50. The autofocus device of claim 49, said light intensity 
measurement unit further being operable to compute a standard deviation of 
said intensity over said image. 

51. The autofocus device of claim 50, further comprising a 
thresholder associated with said light intensity measurement unit for using said 
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average intensity and said standard deviation to compute an image intensity 



threshold for thresholding pixels of said image. 

52. The autofocus device of claim 51, wherein said image intensity 
threshold is tiie average intensij^ plus a predetermined image constant times the 
standard deviation. 

53. The autofocus device of claim 51, wherein said thresholder is 
operable to compute a focusing threshold in addition to said image direshold. 

54. The autofocus device of claim 53, wherein said focusing 
threshold is the average intensity plus a predetermined focusing constant times 
the standard deviation. 

55. The autofocus device of claim 46, wherein said small object filter 
is operable to form a mask from an image taken at a predetermined focus 
position by setting to zero any pixel not bemg part of an object that is smaller 
than a predetermined large object threshold. 

56. The autofocus device of claim 55, further comprising 
combination logic for ANDing said thresholded image with said mask, thereby 
to form an image delineating said objects of interest. 
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57. The autofocxis device of claim 56, further comprising a noise 
remover operable to set to zero each pixel of said image lacking at least one 
non-zero pixel as a neighbor. 

58. The autofocus device of claim 57, wherein said noise remover 
comprises a rank filter. 

59. The autofocus device of claim 58, further comprising a focus 
scorer for computing a focus score to an image, the focus scorer comprising a 
summator for summing over substantially each pixel in the image the 
differ^ce, raised to the power of a predetermined constant, between the pixel 
intensity level and the average intensity level for the image. 

60. The autofocus device of claim 59, wherein said predetermined 
constant is a positive number. 

61. The autofocus device of claim 60, wherein said predetermined 
constant is substantially 2. 

62. The autofocus device of claim 61, further comprising a 
comparator associated with said focus scorer, for determining which of said 
images gives a maximum score, thereby to alter said distance to a distance 
corresponding to said position to focus said sample. 
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63. The autofocus device of claim 44, comprising an exposure timer 
having a predetermined exposure time for producing focusing images and a 
predetamined e5q)osure time for producing viewing unages and wherein said 
predetermined exposure time for producing focusing images is shorter than said 
predetermined exposure time for producing viewing images. 

64. The autofocus device of claim 63, wherein a ratio between said 

•* 

exposure times is substantially between a fifth and a fortieth. 

65. The autofocus device of claim 63, wherein a ratio between said 
exposure times is substantially between a tenth and a twentieth. 

66. The autofocus device of claim 63, wherein a ratio between said 
exposure times is obtainable by takmg the square root of a ratio between a 
typical image SNR and an empirically determined SNR for a given focused 
image. 

67. The autofocus device of claim 63, said e;q)osure timer being set 
to increase said predetermined exposure time for producing focusing images in 
the event of a determination of a focusing failure. 
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68. The autofocus device of claim 59, comprising a comparator for 
determining a difference between focus scores of successive images, said 
apparatus being operable to reduce ejqposure time when said difference is above 
a predetermined level. 

69. The autofocus device of claim 68, further comprising a focus 
score adjuster operable to adjust respective focus scores of focusing images to 
compensate for said reductions in said exposure time. 

70. The autofocus device of claim 44, further comprising pixel 
binning functionality to increase a signal to noise ratio of said images. 

71. The autofocus device of claim 44, comprising a low 
magnification pre-scaimer for detomining wheflier large objects are present in 
a sample to be imaged, arid inhibiting the operation of said server unit in the 
presence of said large objects. 

72. The autofocus device of claim 44, wherein said li^t intensity 
detection unit comprises a multi-pixel array. 

73. An autofocus device for a fluorescence imaging microscope, the 
device comprising an image filter for filtering an image to delineate objects of 
interest and a light intensity measurement unit associated with a focusing 
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mechanism for focusing by altering a focus distance to maximize measured 
light intensity of said filtered image. 

74. The autofocus device of claim 73, being operable to cany out 
said focusing using image data gathering at a lower data level than a data level 
needed for imaging. 
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